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Abstract 

A moderate deviation principle for nonlinear functions of Gaussian 
processes is established. The nonlinear functions need not be locally 
bounded. Especially, the logarithm is allowed. (Thus, small deviations 
of the process are relevant.) Both discrete and continuous time is 
treated. An integrable power-like decay of the correlation function is 
assumed. 



Introduction 

Questions on moderate deviations of random complex zeros lead natu- 
rally to questions on moderate deviations of the logarithm of the absolute 
value of a complex-valued Gaussian random field. Recently, Djellout, Guillin 
and Wu established a moderate deviation principle for (nonlinear) functions 
of dependent random variables (Gaussian, and more general) [31 Th. 2.7]. 
However, their result does not answer the questions mentioned above, for 
several reasons. The most important reason is that the logarithm is not a 
differentiable function (nor even locally bounded). 

The main result of the present work is another moderate deviation prin- 
ciple. Unlike [3], I restrict myself to Gaussian processes, but admit some 
non-locally-bounded functions (like the logarithm). My technique is rather 
far from that of and includes some arguments about small deviations. 
Indeed, small values of the process lead to large negative values of the loga- 
rithm. 



1 This research was supported by the ISRAEL SCIENCE foundation (grant No. 683/05). 
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1 Assumptions on the (nonlinear) function 

Let F : W d — > R be a measurable function satisfying 

(1.1) |Fd 7 d = 0, 

(1.2) yVd 7 d <oo, Je~ F d 1 d <oo- 

here and henceforth 7 d is the standard Gaussian measure on R d , 
7 d (dx) = (27r)- d / 2 exp(-^|x| 2 )dx. 

For any r G (0, oo) we define F r : R d — > (— oo, +oo] by 

(1.3) ^0*0= sup F(y). 

\y-x\<r 

Here is the main assumption on F: there exists C < oo such that 



;i.4) 



y exp(F r (x + 0.5y) - F(x + 0.5y)) 7 d (dy) < e Cr 



for all x G R d and r G (0, oo). 

Assumptions (11. lj) . ( 11.211 . fll.4jl will be referred to as 'i/ie assumptions of 
Sect. r. 

Clearly, these assumptions are not invariant under replacement of F with 
aF for an arbitrary coefficient a G (— oo,0) U (0, oo). (Even a = —1 is 
not permitted by fll.4jl .) However, our main results (Theorems 13.11 l3~2l) are 
evidently invariant under such replacement. Thus, we could assume that aF 
satisfies flU), (Ojl . (EED) for some a 0. 

1.5 Example. Let F be a Lipschitz function, that is, |F(x)— F(?/)| < C|x— y| 
for all x, y G R d . Then the function F(-) — J Fd7 d satisfies the conditions. 
Especially, (jl.4p holds just because F r (x) < F(x) + Cr. 

1.6 Example. Let d > 2. The function 



F W = ln W -/lnN/(d I ) 



satisfies the conditions. Proof of (11.41) : if \y — x\ < r then F(y) — F(x) 
In M < In < ln(l + fa) , thus, F r (x) - F(x) < ln(l + ^) and 



exp(F r (0.5 2 /)-F(0.5 2 /))7 (i (d 2 /)< ^ (l + ) Y(dy) = 

= 1 + 2r y p 7 d (dy) < exp (2r J ^ 7 d (dy) N 
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which is (jl.4j) for x = 0. For arbitrary x we have 



/ V ^ 1 l d (dy)< [ J- 7 d (dy), 
J \x + y\ J \y\ 

which follows from the Anderson inequality, see for instance [21 Th. 1.8.5 and 
Cor. 1.8.6]. 

Taking the limit r -> in (fOl) we get / \ VF(x + 0.5?/) | 7 d (dy) < C for 
a smooth F; by approximation, (jl.4p implies that the first derivatives of F 
are locally finite measures. For the one-dimensional case (d = 1) it means 
that (11.4p can hold only for locally bounded F. (However, F need not be 
continuous.) Especially, the function x \— > In \x\ on M. violates (11.4p . 

2 Assumptions on the Gaussian process 

Discrete time 

Similarly to [3] we consider a process (X„) neZ that can be written in the 
form 

(2.1) X n = O-j-nij — a jin+j 

('moving average process'), where ^ n are independent. (About convergence 
of the series, see below.) Unlike [3] we assume that each £ n is an R '- valued 
random variable distributed 7 d , and each aj is a matrix d x d. We assume 
that each X n is also distributed 7 d ; it means that Yl a j a *j ls the unit matrix. 
(Here a* is the conjugate matrix.) The main assumption: 



(2.2) 




for some e > . 



The said above will be referred to as 'the assumptions of Sect. 2 for 
discrete time'. 

It follows from ( 12.2ft that X] ll a jll < 00 > which is more than enough for 
convergence of the series ( 12.11) . The Fourier transform 

is a continuous 27r-periodic matrix-valued function. The same holds for the 
spectral density /, 

f(6) = ^-g(e)g*(6) ; f d nd f(9)d9 = E (X n X*) . 
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It follows from (12. 2p that \\g{6) - g(rj)\\ = 0(\6 - r/| - 5+e ) (see for instance 
[U Sect. 11.3]). On the other hand, every twice continuously differentiable 
(matrix- valued) function g is Fourier transform of a sequence (a,j)j satisfying 
(12~2D for e = 0.5. 

If /(•) is continuously differentiable twice and det/(-) does not vanish 
then /(•) is of the form f(6) = (2Tr)- 1 g(e)g*(6) with g(-) satisfying (Ol . 
(Just take the positive square root of the positive matrix f{6).) Thus, 
a process with such a spectral density belongs to our class, provided that 
/_. f(0) d8 is the unit matrix, and the process is centered (zero- mean). 

Continuous time 

Here we consider a process (X f ) tgK that can be written in the form 
(2.3) X t = a s _ t dw s = / a s dw 



H+s i 

where (w s ) s( zr is the standard <i-dimensional Brownian motion (two-sided; 
the past s < and the future s > are independent, and w = 0), and 
s i— > a s is a continuous matrix-valued function on IR. (The matrices are of 
size dxd.) We assume that each X t is distributed 7 d ; it means that / a s a* ds 
is the unit matrix. The main assumption: there exists e > such that the 
function s t— > (\s\ + l) L5+e a s is bounded and Holder continuous; that is, 

(2.4) sup(|s| + 1) L5+£ |K|| < oo, 

(2.5) sup ll(|.Xl) 1 ^Y- (l ' l + 1)1 ^'- ll <co. 

seM,<5e(o,i) " £ 

The said above will be referred to as 'the assumptions of Sect. 2 for 
continuous time'. 

It follows from (12.4ft that J \\a s \\ ds < oo, which is more than enough for 
the linear stochastic integrals (12.31) to be well-defined. The Fourier transform 

oo 

iXs 



g(X)= / a s e lAs ds 

J — oo 

is a continuous matrix-valued function. The same holds for the spectral 
density /, 

1 f°° 
/(A) = 7r g(X)g*(X) ; / e iA4 /(A)dA = E (X t X*) . 

It follows from (J23D, O that 

g(X) = 0(\\n , g(X) - gfr) = 0(\X- ^) . 
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On the other hand, every twice continuously differentiable (matrix-valued) 
function g such that g(A) and g"(X) are 0(|A| _1_e ) (as |A| — > oo) is Fourier 
transform of a function s i— > a s such that the functions s i-> a s and s >— > s 2 a s 
are bounded and Holder continuous, thus, ( 12. 4ft . ( 12. 5ft are satisfied. 

3 The result 

3.1 Theorem. Let a function F : R d — > R satisfy the assumptions of Sect. 1, 
and a process (X n ) ne z satisfy the assumptions of Sect. 2 for discrete time. 
Then 

(a) the following limit exists: 

a 2 = lim I E ((F(X 1 ) + --- + F(X„)) 2 ); 

(b) if a ^ then for every /5 G (0, 0.5) and A G R, 

1 /A \ A 2 

InEexp — -(F(X 1 ) + ■ ■ ■ + F(X n )) )^— asn^oo. 



1-2/3"^^ Van/ 3 V ■ ■ V-nyy , 2 



3.2 Theorem. Let a function F : R d — > R satisfy the assumptions of Sect. 1, 
and a process (X t )tm satisfy the assumptions of Sect. 2 for continuous time. 
Then 

(a) the following limit exists: 

a 2 = lim \ E (f o F ( X s) ds) ! 

(b) if a j£ then for every (3 G (0, 0.5) and A G R, 

1 / A f* A A 2 

^-^lnEexpf — J F(X s )&s\^— as t -> oo . 

It follows by the Gartner-Ellis theorem (see j ii Sect. 8]) that for every 
c G [0, oo), 

lnP(F(Xi) + • • • + F(X„) < -can 1 -' 3 ) -> , 



. ,2 



lnP(F(Xx) + • • • + F(X„) > can 1 - ' > 
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as n — > oo (discrete time), and 

-±^lnF (j F(X s )ds< -cat 1 ' A - , 

inP ( ^ ds > c ^ 1_/3 ) ^ -y 

as t — > oo (continuous time). 

4 Splitting the process 

Discrete time 

Given a process (X„) ngZ satisfying the assumptions of Sect. 2 for discrete 
time, and its representation (12.11) . we may split the process in two indepen- 
dent processes, 

Xx^past I -^future 
" — A n + A n J 

j<0 j>0 

4.1 Lemma. There exists e > such that 

sup((n+ l) 1+£ |X^ urc |) < oo and sup(n 1+e |XP ast |) < oo a.s. 

n>0 ' n>0 

Proof. For n > 0, using (12.21) . 



OO 

2-2e\ 



E |X fo rT = X> ace (°i+-S*+J ^ const ■ E FT A3 +2£ = °(" 

J=l 3=1 U + ^ 

Thus, E„>o P (l X -T rc | > n -1-0,56 ) < oo (since X^ ure is Gaussian); the 
statement on X future follows. The statement on X past is similar. □ 

Continuous time 

Given a process (X t ) t6K satisfying the assumptions of Sect. 2 for con- 
tinuous time, and its representation (12.31) . we may split the process in two 
independent processes, 

^ ^past _|_ j^-future 

/0 ^00 
a s _ t dw s , X^ e = / a s . t dw s . 
-oo J0 
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4.2 Lemma. There exists e > such that 

sup((t + l) 1+£ |X^ turc |) < oo and sup((f + l) 1+£ |^ past |) < °o a.s. 

t>0 t>0 

The proof, given afterwards, uses the following (quite general) lemma. 

4.3 Lemma. Let ip : [0, oo) — > H. and e > be such that the function 
x t— > (x + l)°" 5+£ </?(x) is bounded and Holder continuous, that is, 

sup((l + x) - 5+£ \(p(x)\) < oo , 

x>0 

|(l + x + 5)°- 5+£ ip(x + 5)-(l+ x)°- 5+£ <p(x) I 
sup — — t-^ Z -^ LL < oo 

x>0,0<<5<1 O a 

for a given a G (0, 1]. Then there exists C < oo such that for all y G [0, oo) 
and 5 G [0, 1] 

poo 

/ + + <5) £ v?(y + 5 + a;) - (l + y) £ <p(y + x)\ 2 dx < C5 2a . 
Jo 

Proof. Denote ip(x) = (1 + x)°' 5+£ </?(x). Choosing for every x some z x G 
[y, y + 5] we have 

(1 + y + 5) £ v9(i/ + 5 + x) - (1 + y) £ V {y + x) = 



(1 + y + 5 + x)°- 5+e v 7 (1 + y + x) a5+e 

where 

4. = (1 + y + g + ^0. 5+e (^^ + ^ + g ) - ^ + g )) ' 

5 = f (l±i±j)! (i + y) 8 W +x) 

x \(l + y + 5 + x)°- 5 + £ (1 + y + x)°- 5 + £ 7 ^ * + ' ' 

c * = (i + y + a; )o.5 +£ M** + x ) - + x )) ■ 

Due to the triangle inequality in L 2 (0, oo) it is sufficient to choose z x (measur- 
able in x) such that J °° A\ dx = 0(5 2a ), J °° B 2 X dx = 0(5 2a ) and f™ C 2 dx = 
0(5 2a ). We have 

[ma* = (i +y+f )*jT o( te+ f-^n + ^ + ^ = o(o . 
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Similarly, J °° C x dx = 0(5 2a ). These two statements hold irrespective of the 
choice of z x 6 [y, y + S). Now we choose z x such that 



y + Sf (1 + yf _ 6 _d 



1 + y + 5 + x)°- 5+£ (1 + y + x)°- 5+£ dz 



\l + z) 



'l + z + x)°- 5 + £ 



. (l + z x y ( e 0.5 + e 

o- 



1 + z x + x)°- 5+£ \l + z x l + z x + xj' 

The bracketed difference is evidently bounded; ip(z x + x) is also bounded, 
thus, 

\B X \ < const -o— — ; ; — rTTTT" < const -o- 



1 + ^ + x)°- 5 + £ ~ (1 + y + a;) - 5 + £ ' 

□ 

Proof of Lemma 14.21 First, for every t > 0, using (12. 4p . 



/■oo 

E |j^ ture | 2 = / trace(a s+ ta: +t ) ds < 
Jo 



Second, we note that Lemma 14.31 holds also for vector- valued (and matrix- 
valued) functions, and apply it to the function (p(t) = a t (t > 0), e in place 
of a and 1 + e in pace of e (recall (12.51) ). We get 

/■oo 

sup / || (t + 1 + 5) l+£ a t+5+s - (t + l) 1+ "a t+s \\ 2 HS ds = 0(5 2e ) 
t>0 Jo 

for S < 1; here || • ||hs is the Hilbert-Schmidt norm, ||a||jj S = trace (aa*). 
Thus, 

supE \{t + 1 + S) 1+e X^ - (t + i)i+^x^ turc | 2 = 0(5 2£ ) , 
t>o 

supE |(t + l)l+^to«|2 < oo . 
t>0 

It follows that the sample paths of the Gaussian process ((t + l) 1+e X^ u t ture ) t > 
are locally bounded (in fact, continuous). The corresponding estimations are 
uniform, thus (see for instance [21 Th. 7.1.2]) 

sup E sup | (t + 1 ) 1+£ I^ ture | < oo 

n>0 te[n,n+l] 
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and moreover, 

sup P ( sup | (t + 1) 1+6 X^ me | > C ] 

decays rapidly as C — ► oo, namely, it is 0(e~ 5c ' 2 ) for some 6 > (which can 
be obtained by Fernique's theorem, see for instance [21 Th. 2.8.5]). By the 
Borel-Cantelli lemma, 

y>( max ((l + t) 1+£ |X fu , turc |) > n £/2 ^) < oo. 

^ V'e[n,n + l] VV / 

Therefore 

SU P ((t + l)l+0-5 £ | X futurc|^ < ^ a _ g _ 

The statement on X past is similar. □ 



5 A small deviation argument 

Discrete time 

Let (X n ) n£ z be a process satisfying the assumptions of Sect. 2 for discrete 
time. 

5.1 Lemma. For every o G (0, 1) there exist m G {1,2,...} and an Reval- 
ued stationary Gaussian process {Y k ) k ^i such that the two processes 

(X mk ) k£ z and (Y k + cr£k)k<=z 

are identically distributed; here are independent Revalued random vari- 
ables, each distributed 7 d , and the process (£*;)fcez is independent of the 
process (Yfc)fcez@ 

Proof. Here is a condition sufficient (and necessary, in fact) for existence of 
such (Ffc)fc (for given m and a): the spectral density f m of the process (X mk )k 
should exceed the spectral density of the process (cr^)fc- That is, we need 

/ m (0)>^r 2 /; 

here / is the unit matrix, and the inequality means that all the eigenvalues 
of the Hermitian matrix f m (6) lie on [a 2 , oo). 

2 mk in X mk is just the product of m and k. 
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We have 



/m(9) = I( / («) +/ (»±*L) + ... + / (« + Mm-i: 



m 



the spectral density / of the given process (X n ) n being a continuous 27r-peri- 
odic matrix- valued function on R such that J"^ f{6) dO = I (recall Sect. ED- 
Therefore f m (9) — > (27r) -1 / (as m — > oo) uniformly in 0. It follows that 
/m(0) > (27r)~ 1 o" 2 / for all 6 1 , if m is large enough. □ 

Continuous time 

Let (X t )teR be a process satisfying the assumptions of Sect. 2 for contin- 
uous time. 

5.2 Lemma. For every a G (0, 1) there exist t G (0, oo) and a discrete-time 
Revalued stationary Gaussian process {Y k ) k( z% such that the two discrete- 
time processes 

(Xtk)kez an d (Xk + c£,k)k£Z 

are identically distributed; here are independent Revalued random vari- 
ables, each distributed 7 d , and the process (£fc)fc e z is independent of the 
process (Y k ) keZ . 

Proof. Similarly to the proof of Lemma 15.11 we consider the spectral density 
ft(-) of the process (X tk ) k and prove the inequality f t {6) > (27r) _1 a 2 / (which 
is sufficient). 
We have 



the spectral density / of the given process (X t )t being an integrable con- 
tinuous matrix- valued function on R such that /(A) > for all A, and 
f_°^ /(A) dA = I (recall Sect. [2]). 
For M large enough, 



M 

2 



/(A) dA > (a 2 + e)I for some e > 

M 



For t large enough, 

/t(0) > 7^ / /(A) dA - ^-el > ^a 2 / for all 5 . 

□ 



27T 7_jy 27T 27T 
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6 Surgery 

Discrete time 

Let (X n ) ne i be a process satisfying the assumptions of Sect. 2 for discrete 
time, and (Y n ) ne z its independent copy. We apply the split of Sect. H]to both: 



j£ j^-past _|_ j^-future -y ypast _|_ ^future 

The four processes x past , X future , y past , F future are independent. The pro- 
cesses X past and yp ast are identically distributed; symbolically X past ~ yp ast . 
Also X futurc ~ y future _ Thus, we have four identically distributed stationary 
processes: 

j£ j^-past _|_ j^-future ^ j^-past _|_ ^future ^ y past _|_ j^-future ^ y past _|_ y future y 

Let F be a function satisfying the assumptions of Sect. [TJ We introduce 

n 
k=l 

n— 1 n 
k=0 k=l 

denote by /i n the distribution of S£ uture (X), symbolically S^ uturc (X) ~ /i n , 
and observe that 5 past (X) ~ /i n and S past (X) + S£ uturc (X) ~ /i m+n . Further, 
we introduce 

^-jpast gpast ^ j^-past _|_ -^future ^ ^ipast ^ j^-past _|_ j^-futurc^ 

^future tjifuture ^yr past _|_ j^-futurc^ c^future ^ j^-past _|_ j^-future^ 

and observe that 

(6.1) 5 past (^) + ^ uturc W = 

^ipast / j^-past _|_ yfuturc^ _|_ ^ifuture /ypast _|_ j^-future^ ^past ^future 

This fact is instrumental to our purpose, since the two random variables 
S past (X past + Y futuve ), Suture (ypast + ^future) are independent, distributed 
/x m ,/i n respectively, and the distribution of their sum is close to fi m+n as far 
as £> past + D^ ture is relatively small. 

6.2 Lemma. There exists e > such that 

supE exp(epP ast |) < oo , supE exp(£|D^ ture |) < oo . 

n>0 n>0 
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Proof. It is sufficient to prove that 

supE exp(eD^ turc ) < oo , 

n>0 

since the distribution of D i ^ tme is symmetric (around 0), and the assumptions 
of Sect. [2] are invariant under time reversal. Equivalently, we may prove that 

(6.3) supP(L£ uture >C)= 0(e~ £C ) 

n>0 

for some e > and all C > 0. 

By Lemma HH1 sup fc>0 (/c 1+£ |X| >ast |) < oo a.s. The same holds for yp ast . 
We consider events 

A u : sup(A; 1+£ |Xr st -n past |) <u. 

k>0 

Fernique's theorem (mentioned in Sect. HJ) gives us 5 > such that 

(6.4) P(A) > 1 - 2e~ 5 " 2 for u G (0, oo) . 

We introduce Z Ujk = F uk -i-e(X k ) — F(X k ) > (where F uk -i-e means F r 
of ( II. 3D for r = uk~ l ~ £ ) and Z u = J2k>o^ u , k e [0, oo]. The intersection 
of A u and the event D f ^ ture > C is contained in the event Z u > C, since 
l^qmst _ y^P ast | < u fc- l - £ implies 

Thus, 

(6.5) supP(/^ uturc > C) <¥(Z U > C) + l-P(A u ) . 

n>0 

Lemma HO for a = 0.5 gives us m G {1,2,...} and (Yfc)fcez such that 
(X mk ) k ~ (r fc + 0.5^ fc ) fc . We have 

m 

^ ^ ^u,k ^ ^ ^ ^u,mk+j j 
fc>0 j=l fc>0 

1 m ( \ 

exp(m -1 Z u ) < — ^exp ( 2j ^n,mfc+j J • 

j=l ^ fc>0 ' 

For each j G {l,...,m}, X]fc>o = J^k^oi^Hmk+j^-^^mk+j) — 

F(X mk+j )) is distributed like J2k>o{ F u(rnk+j)^-c(,Yk + 0-5£k) - F(Y k + 0.5£, k )) . 
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For every (nonrandom) sequence (y k )k, using (11.41) and denoting the constant 
C of (HID by C F , 



fc>0 



E exp ( ^ (F u ( mk+j) -i- e (y k + 0.5£ fc ) - F(y k + 0.5&)) 
II E exp 

(Vk + 0.5^ fc ) - F{y k + 0.5&)) < 

fc>0 

J^exp(CV«(m/c + j) -1 ~ e ) = exp ^CVu ^(m/c + j) l e ) < exp(£??i) , 



fc>0 

< 



/.■ -n fc>o 
where 5 = CF^2 k>0 (mk + l)~ 1-£ < oo. Therefore 



E exp ( ^2 

k>0 

= E exp ^(F u(mfc+i) -i- e (n + 0.5^) - + 0.5£ fc ))) < exp(Bu) 

fc>0 

and E exp(m _1 Z u ) < e Bu , which implies 

¥(Z U > C) < exp(Bu - m^C) . 
We return to and (l6~4l : 

supP(/^ uturc > C) < exp(5u - m _1 C) + 2e~ 5u2 

n>0 

for every it e (0, oo). Taking it = v^C* we get (16. 3p . □ 
Continuous time 

Let (X t ) t& -R be a process satisfying the assumptions of Sect. 2 for con- 
tinuous time, and F a function satisfying the assumptions of Sect. HJ We 
proceed similarly to the discrete-time case: X = X past + X future , Y = 

ypast + yfuture ^ S ^ e (X) = f*F(X s )ds, S^X) = J^F(X s )ds; 
^future = 5 futurc^ y past +X futurc) _ 5 future( X pa St + X future^ &nd similarly £>P^ 

We get 



(6.6) Sf st (X) + Sl utme {X) = 

^future 



jifuture ^ 

Cjipast / j^-past _|_ -^future ^ _|_ ^future past _|_ j^-futurc^ ^past 

6.7 Lemma. There exists e > such that 

sup E exp (e | Df^ | ) < oo , sup E exp (e | Df" turc | ) < oo . 

t>0 t>0 
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The proof being quite similar to that of Lemma 16.21 I give a sketch. 
Events 

A u : sup((t + l) 1+£ |Xr st - Y t past \) < u 



t>o 

,2 



satisfy P(v4 u ) > 1 — 2e Su by Lemma 14.21 and Fernique's theorem. We 
introduce Z u>t = F u{t+1) -i-e(X t ) - F(X t ) > 0, Z u = J °° Z Ujt dt G [0, oo] and 
get 

supP(A futurc > C) < F(Z U > C) + 2e~ Su2 . 
t>o 

Lemma l5\2l for a = 0.5 gives T and (Yk)k such that {Xxk)k ~ (Y k + 0.5£, k ) k . 
We have 



POO pi 

Z u — I Zu,t dt = ds Z u ^k+s ] 
Jo Jo fc > 

exp(T~ 1 Z u ) < — I dsexp ( V" Z U)Tk+ A . 

1 J o ^k>0 ' 

We use (11.41) as before: 

E exp (^2(F u(Tk+s+1) -i-.(y k + 0.5£ fc ) - F(y k + 0.5&)) J < exp(Bu) 



k>0 



where B = C F Y,k>o( Tk + 1)~ 1_£ < oo. Thus, E exp y Y^k>o Z u,Tk+sj < 
exp(Bu); E exp(T~%) < e Bu ; F(Z U > C) < exp(Bu - T^C). Finally, 
u = leads to sup t>0 P (D t futurc > C) = 0(e~ £C ). 



7 Asymptotic variance 

Discrete time 

Here we prove Item (a) of Theorem 13.11 

Let \i n be the distribution of F(Xi) + • — h F(X n ). According to Sect. El 
Hm+n is close to the convolution \i m * \i n in the following sense. There exist 
random variables S m>n , S' m , S" such that 

(7.1) S' m and are independent , 

Eexp(e\S m , n -S' m -S';\) <C 
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for some e > 0, C < oo not depending on to, n. Namely, 

S^ St (X) + S^ tUVC (X), S' m = SP^t(XP ast + y fttture ), = Suture (ypa S t +X futo e ) 

and note that 

E exp{e\S m , n — S' m — S"\) < E exp^L^I + < 

< (E exp(2e| J DP ast |)) 1/2 (E exp(2£|Z^ uturc |)) 1/2 < C 

by (16. ip and Lemma 16.21 if e is small enough and C is large enough. 
Also, 

(7.2) y"e |x| /ii(dx) < oo 

by fll.2p . In this section we need only second moments: J x 2 fii(dx) < oo 
and 

supE \S mjn - S' m - S"\ 2 < oo . 

m,n 

Taking into account that the expectations vanish by (II. ip . we use orthogo- 
nality and the triangle inequality in the space L2 of random variables: 

SUP I \\S m>n \\ " V\\S' m \\ 2 +\\Sn\\ 2 \ < OO . 



Thus, the numbers 



a 2 n = J x 2 fi n (dx) =E(F(X 1 ) + --- + F(X n )) 2 
satisfy 

sup \a m+n - a/ct^ + a 2 1 < 00 . 

m,n 

Existence of limfc(2~ fc / 2 cr 2 fc) could be deduced readily, but existence of 
lim„ needs more effort. Here are two quite general lemmas. 

7.3 Lemma. Let numbers a±, 02, - • • G [0, 00) and e > satisfy 

< \ / a 2 n + a 2 n + e 

for all m, n G {1, 2, . . . }. Then 
for all n. 



15 



Proof. For k — 0, 1, 2, . . . consider 



bk = max — p= 

n<2* i/ll 



For each n G {1, 2, 3, . . . , 2 fc } 



< 



<■ . < Ofe + 



n 



71 



therefore 



b k+ i <b k + T k l 2 e ■ b k <b + 



V2 



V2- 1 



However, 6 = a i- 
Similarly, 



□ 



(7.4) if a m+n > \Ja? m + al - e then a ri > 
7.5 Lemma. Let numbers ai, • ■ ■ G [0, oo) satisfy 



v/2 



v 7 ^- 1 



e h/n 



sup 



|a m+n - a/o^ + I < oo . 



Then there exists lim n (a n /-y/n) G [0, oo). 

Proof. Denote the given supremum by C. For any k G {1,2,...} we may 
apply Lemma I7T31 (together with (17.41) ) to the sequence (a fc , a 2k , ■ ■ ■ ), obtain- 
ing 



\a n k ~ a k y/n\ < 



V2 



y/2-1 



a k 



nk \fk 



< 



vg c 

V2-lVk' 



All limiting points of the sequence (a n k/ Vnk) n belong to the 0(l/yk) -neigh- 
borhood of the number ak/Vk. The same holds for all limiting points of the 
sequence [a n j y/n) n , since for 9 G {0, 1, . . . , k — 1} 



Ukn+9 



12 T 2 



< C: 



+ 



fcn kn + 9 



O-kn+6 

y/kn+~9 



< 



c 



Vkn + 9 
<o(l). 
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Let x be a limiting point of (a n /^/n) n , then 



x — 



< 



V2 C 



Vk V2-1 Vk 

for all k. Thus, a^/y/k — » x. □ 

It remains to apply Lemma 1731 to the sequence (cr n ) n . 
Continuous time 

Item (a) of Theorem 13.21 is verified similarly to that of Theorem 13.11 We 
consider the distribution /i t of J * F(X S ) ds and note that fi s+t is close to 
/i s * fi t similarly to (17.11) . Also, 



(7.6) 

The numbers 



E exp ( - 



F(X S ) ds 



< E exp|F(X )| < 00. 



<j, 



x 2 Ht(dx) = E 



t \ 2 

F{X S ) ds 



defined for t G [0, 00) satisfy 



sup a s < 00 for t < 00 , 

se(o,t) 



sup 

s,t 



O's+t 



a 2 + a 2 



< 00 . 



7.7 Lemma. Let a function a : [0, 00) — > [0, 00) satisfy 



sup 

s,t 



a(s + t) - \/a 2 (s) + a 2 [t) 



< 00 



and be bounded on [0, t] for some (therefore, every) t > 0. Then there exists 
hm t _ >0O (a(t)/Vi) e [0,oo). 

The proof is similar to that of Lemma 17.51 For any t G (0, 00) we apply 
Lemma [7.31 (and (17.41) ) to the sequence (a{nt)) n . A limiting point x of the 
function s 1— > a(s)/yfs is also a limiting point of the sequence (a{nt)/^/nt) n 
(boundedness of a(-) on [0, t] is used here), and we get \x — ^| < 



It remains to apply Lemma [7.71 to the function 1 1— ► at- 
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8 Asymptotic exponential moments 

Discrete time 

Here we prove Item (b) of Theorem 13.11 

Recall the numbers a G (0, oo) from Item (a), (3 G (0, 0.5) from Item (b), 
e > from (17.11) . Denote 5 m>n — S' m — S" from (17. ip by R m ,n- Taking into 
account that Ei? min = we get 

E exjp(uR m< n) < exjp(Co 2 u 2 ) 
for some C < oo and all u G [— e, e]. We define functions tp n by 

/A A 
exp (^z) /in(dx) = E exp (— (F(X X )+- ■ -+F(X n ))J G (0,oo]. 

8.1 Lemma. For all m,n and A such that |A| < ea(m + n)^^ 2 , 



\p\m + nJ J \p\ 



1 / n \P 



m + n 



A exp - C- 



A 2 



p(m + n) 3/3 / 2 



< 



<^ /p |P 



m + n/ 



n \/» 



where 
(8.2) 



(m 



P 



,m + n 



+ n)^ 2 



A exp C 



A 2 



(m + n) 3 / 3 / 2 



m + nf/ 2 - 1 
Proof. The upper bound for <£> m+n (A): first, 

A 



A 



y? m+ „(A) = E exp (— ■ — r^Sm.n) = E exp (— — - — — (S' m +S'^+R 

\a{m + // j / \n 

A 6^ + 30) ' exp( :/?„ 



< 



exp 



,(r(m + n)P 
where q = (m + n)^l 2 . Second, 



cr(m + n)P 



A 



eX P \ / no- 11 "??!,?! 

cr(m + n) p 

1 



E exp I g 



A 



< exp 



■Co* 



o(m + n)P 
A n 2 



Rr, 



1/9 



am 



exp ^C- 



< 
A 2 



m + n) 3 ^ 3 / 2 - 
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Third, 



exp 



A 



aim + n)P 



E exp [p 



A 



aim + n)P 



(S m +S n ^ 



E exp (p— 



A 



m + nY 



l/p 



E exp [p 



A 



aim + n)^ 



l/p 



l/p 



and 



E exp [p 



A 



cr(m + n)< 



E exp 



1 



IP 



m \ P 



am 13 \m + n 



\S, n 



m \P 



m + n 



A 



the same for S". 

The lower bound for y?m+ n (A): first, 



m 



p \m + n 
= E exp 



J V V \m + n/ 



1 1 / m \P 



= E exp 



1 



amP p\m + n 
A 



p \m + 

AS^ • E exp 



1 1 



n 



anP p \m + n 



\S" I — 



< 



p aim + n)P 

/l A 
exp - 



(5^ + 5^ = E exp (- X w (S m , n -R m , n )) < 
J \pa(m + nY J 



pa (in - a)P m ' n ) 



exp 



V pa 



A 



)P Rm ' n ) 



Second, the L q norm is estimated by exp (C ( m+ ^)3/a/2 ) m the same way 

as before. Third, the L p norm is (E exp ( j(m ^ g m , n ) ) 1/p = ^m+n( A )- It 
remains to raise all that to the power p. □ 

Given a number £i e (0, e], we consider (for every n) the smallest 6 n and 
the largest a n such that the inequalities 

(8.3) exp(0.5ra 1_2/J a n A 2 ) < ip n {\) < exp(0.5n 1 " 2/3 6„A 2 ) 

hold for all A satisfying |A| < ei<rn /3//2 . 

8.4 Lemma. There exists N such that for all m, n satisfying N < m < n < 
2m, 



Q"tn+n 



J m+n 



> 



(m + nY /2 - 1 



< 



(m 



[m 



ma r 



na r 



2C 



m + n 



+ n)P/ 2 
_l_ n )/3/ 2 mb m + 



+ 



(m + ny-°- 5 P 
2C 



'm + n)P/ 2 -l m + n (m + n) 1 " - 5 ^' 
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Proof. The bound for a m+n will be verified for all m,n. Let |A| < e\0~{m 
nfl 2 , then \\{^) & \\ < e x a {m ^ )m < e^m^ 2 (p is still defined by 
thus 

hr A >exp p.-m 1 -^^ — A 
ypVm + n/ J \ 2 p 2 \m + n/ 

exp ( ~(m + n) 1-2/3 A 2 • - 
V 2 P 



pm + n 



The same holds for . . ); Lemma [87T1 gives 



VWn(A) > exp -(m + ra) P A 



2 p\ m + n (m + n) 1 " - 5 ' 3 / 

which verifies the bound for a m+n . 

We take N such that 1.5~^ 2 + (2iV)~^ 2 < 1. Let iV < m < n < 2m, 
then 

therefore |A| < £kt(to + nfl 2 implies |p(^)^A| < (^)^ /2 |A| < eicrn^ 2 
and 

Wpf— YA < exp C i • in-^,, . p'f^^V 



m + n/ J \p 2 \m + n 



exp | -(m + n) 1 2/3 A 2 ■ p — ) . 

V 2 m + n) 



The same holds for ipm P (. . . ); Lemma EJ] gives 

m . /% . ni-2/3 X 2 ( mb m + nb n 2C \\ 

ip m+n (X) < exp - m + n) P X ■ [p + -, ■ — ^jz^g j , 

\2 V m + n (m + nj 1 u - op J J 

which verifies the bound for b m+n . □ 
Here are two quite general lemmas. 

8.5 Lemma. Let numbers B 1 ,B 2 ,--- G [0, oo), a G (0, oo) and r e [0,1] 
satisfy 

(m + n)" m,B m + »ij n : r 

-D m+n S 7 : 77 : r 



(m + n) a — r m + n (m + n) c 

for all m, n such that m < n < 2m. Then 

sup B n < (1 + C Q r)5i + C a r 

n 

for some C a that depends on a only 
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Proof. We choose integers n < n\ < . . . such that | < < | for all k, 
and n = 2. We consider 

M fc = max(Si, B 2 ,..., B 2nk ) ■ 

For every integer n G (2rifc, 3nfc] 

B n = B nk+(n _ nk) < ^^M k + — . 

Taking into account that 2n k+ i < Sn k we get 

(2^ + 1)° n . 



M k+1 < " - — ^ M fc + 



fe+1 " (2n fe + 1)« - r^ K ' (2n fc + l)< 
Introducing 



fc-i 



n (2n J + l) _ 

J= o ( 2n J + !) - r 

we have P fc > 1, P k -> < oo, and M fc+1 < ^M fc + (^j^, ^ < 
ft + (2^TTF' therefore 

M fe M ^ 
sup — < — + r 2J2n fc + 1) a ; 

sup P n = sup M k < P^Mo + rP^ ^(2n fe + 1)- Q . 

n k , 

We note that 

B 2 < l^-Bi + ^<(l + C a r)B 1 + C a r ; 

here and henceforth C a is some constant that depends on a only, not neces- 
sarily the same in all occurrences. Similarly, 

B 3 < (1 + C a r) max(P 1 , B 2 ) + C a r < (1 + C Q r)P! + C a r , 

the same for B 4 , and we get 

M = max(P 1 , P 2 , P 3 , B 4 ) < (1 + C a r)Pi + C Q r . 

Finally, n k > 2(4/3) fc , thus 



k=0 k=0 

Poo < exp(C a r) < 1 + (e c « - l)r . 



□ 
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8.6 Lemma. Let numbers Ai,A 2 ,--- G [0, oo), a G (0, oo) and r G [0,1] 
satisfy 

^ (m + n) Q — r mv4 m + nA n r 

m+n ~ (m + n) a m + n (m + rz) a 

for all m, n such that m < n < 2m. Then 

inf A n > (1 - C a r)Ai - C Q r 

n 

for some C a that depends on a only. 

Proof. Let and Pfc be as in the proof of Lemma 18.51 We introduce M k = 
min(Ai, . . . , A 2nk ) and get 

(2n fc + l) a -r r 



(2n fc + 1)° (2n fc + 1)° ' 



Pk+lM k+1 > P k M k - P k+1 r{2n k + iy a ; 
inf P k M k > P M - P^r V(2n fc + 1)-° ; 



k 

k 



inf A n = inf M k > ^ - r V(2n fc + 1)-° > (1 - O)^ - C a 

k 



similarly to the proof of Lemma 18.51 □ 

Recall that a n ,b n defined by (18. 3ft depend implicitly on e\. 

8.7 Lemma. For every 5 > there exist e\ G (0, e] and k G {1, 2, . . . } such 
that 

inf a kn > 1 — 5 and sup h kn < 1 + 5 . 

n n 

Proof. Lemma [8.41 shows that Lemma [8.51 may be applied to B n = b kn , ot = 
(5/2 and r = k~^l 2 max(l, 2C) provided that k exceeds the number N of 
Lemma [H?4l Therefore sup n bk n < {^-+S)bk+S for all k large enough. Similarly 
(using Lemma [HIS]), inf„a fcn > (1 — 5)a k — 5 for all k large enough. Also, 

^ E(F(X 1 ) + --- + F(X fc )) 2 ^ i 
^ ~ 1 + 6 

for all large enough. After choosing such k we choose e\ such that 
exp((l - 5) ■ 0.5^(0)A 2 ) < <p k (\) < exp((l + 5) ■ 0.5^(0)A 2 ) 
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for all A satisfying |A| < E\ok^l 2 \ this is possible, since ^fe(O) = 1 and 

<f/ k {0) = (FiX,) + ■■■ + F(X k )) = . 

Taking into account that 



1 



^(0) = -^E (FiX,) + ■■■ + F(X k )f e [(1 - J)* 1 " 3 * (1 + S)k^ 



a 



k 2(3 



we get 

exp((l - 5) 2 ■ OM^X 2 ) < ip k iX) < exp((l + 5) 2 ■ O^fc 1 " 2 ^ 2 ) , 

which means that b k < (1 + 5) 2 and a k > (1 — 5) 2 . Finally, inf„ a kn > 
(1 - 5) 3 - 5 and sup n b kn > (1 + 5) 3 + 5. □ 

We see that 

for |A| < Eia(kn) 13 / 2 . Now we consider Lp kn +e(X) for 9 E {0, 1, . . . , — 1} and 

assuming that kn+8 is large enough (namely, exceeds 
2 2///3 ). Similarly to the proof of Lemma [8.41 we use Lemma [8.11 Taking into 

account that p = j^^W2Zl — 2 an d 
we get 

^ mJ / A;n \f ,\ / A 2 



= ^ /p (o(l)) -exp (l(A;n) 1 -^(l+5)ip 2 (l + o(l))A 2 ) exp(o(l)) = 

= exp {Ukn + 6) l ^\ 2 (l + 5 + o(l)) + o(l)) 

for large /cn + 0. Similarly, 

¥Wfl(A) > exp (i(fcn + e) l - 2 ?\ 2 (l - 5 + o(l)) + o(l)) , 
which completes the proof of Theorem 13.1( b). 
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Continuous time 
We define 



exp {^^j M da; ) = E exp (-^ jf F(Jf s ) ds) G (0, oo] 



similarly to Lemma 18.11 



p\s + t/ J \p\s + tJ J \ p (s + 1) 3/3 / 2 

< V«+t(A) < 

^('(^i)V('(^i)'0- p ( o ^)' 

where p = J^ < j/ 2 / _ 1 - Given £1 G (0, e], we consider (for every t) the smallest 
&t and the largest a t such that the inequalities 

exp(0.5t 1 - 2/3 a 4 A 2 ) < <pt(X) < exp^M^hX 2 ) 

hold for all A satisfying |A| < e\ot^l 2 . Similarly to Lemma f8.4l there exists 
T such that for all s, t satisfying T < s < t < 2s, 

(s + tf 2 -1 / sa s +ta t 2C 



a s +t > 



s + t)/ 3 / 2 \ s + t (s + t) 1 - - 
{s + tfl 2 sb s + tb t 2C 



~>3 



b s+ t < , \ : . + 



(s + t)/ 3 / 2 -! s + t (s + t) 1 " - 5 / 3 ' 
8.9 Lemma. For every 5 > there exist e± G (0, e] and t G (0, oo) such that 
inf a tn > 1 — 5 and sup b tn < 1 + 5 . 

n n 

Proof. By (18. 8ft . Lemma IH31 may be applied to B n = b tn , a = (3/2 and r = 
t~PI 2 max(l, 2C) provided that t exceeds T of (I8.8p . The rest is completely 
similar to the proof of Lemma 18.71 □ 

We see that 

for |A| < ^^(tn)/ 3 / 2 . Now we consider <^t n+ e(A) for 9 G [0,t] and |A| < 
assuming that tn + 9 is large enough (namely, exceeds 
2 2 // 3 ). We proceed similarly to the discrete case, taking into account that the 
functions ipe(-) are continuous at uniformly in 9 G [0, t], which follows from 
(17.61) and convexity of these functions. 
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